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FIELD OF THE INVENTION 

The present invention relates to apparatus and methods for utilizing communication net- 
works. 

BACKGROUND OF THE INVENTION 

Currently marketed switches and cross-connects are non-blocking. Examples include Alca- 
tel's 1100 (HSS and LSS), 1641 and 1644 switches, AT&T's DAGS II and DAGS III switches 
(Lucent technology), TITAN's 5300 and RN64 series, Siemens EWSXpress 35190 ATM Core 
Switch and Switching Faulty CG155 systems, Newbridge's 3600, 3645, 36150 and 36170 
MainStreet switches and the Stinger family of ATM switches. 

A review of ATM (asynchronous transfer mode) switching products, namely "The ATM 
Report'% Broadband Publishing Corporation, ISSN 10720981X, 1996 surveys 10 switches 
of which nine are completely non-blocking and one, CISCO, has a positive but very low 
blocking probability (3% probability of blocking at 2 Gbps). 

The ITU-T Recommendation G.782 (International Telecommunication Union, Telecom- 
munication Standardization Sector, 01/94) includes Section 4,5 entitled "Blocking" which 
states: 

"The existence of cross-connections in a cross-connect equipment can prevent the set-up 
of a new cross-connection. The blocking factor of a cross-connect is the probability that a 
particular connection request cannot be met, normally expressed as a decimal fraction of 1. 
Fully non-blocking (i.e. blocking factor = 0) cross-connects can be built. Some simplification 
in design, and hence cost, can be realized if a finite blocking factor is acceptable. It is not 
the invention of this Recommendation to specify target blocking factors for individual cross- 
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connect equipment. The impact of non-zero blocking factor on network performance is 
dependent on network design and planning rules. 

"There is a class of cross-connect matrices knoAvn as conditionally non-blocking in which 
there is a finite probability that a connection request may be blocked. In such cross-connects, 
it is possible, by re-arranging existing connections, to make a cross-connection which would 
otherwise be blocked. As an objective, in such cases, rearrangements should be made without 
interruption to rearranged paths. 

"It may be necessary in a nominally non-blocking, or conditionally non-blocking cross- 
es connect, to accept some blocking penalty associated with extensive use of broadcast connec- 
tions. This is for further study." 

A later document "ATM functionality in SONET digital cross-connect systems - generic 
5;!5 criteria", Generic Requirements OR - 2891-CORE, Issue 1, August 1995, Bellcore (Bell Com- 
Ip munications Research) states as a requirement that "A SONET DCS with ATM functionality 
U must meet all existing DCS requirements from TR.NWT-000233" . The TR-NWT-000233 
m publication (Bellcore, Issue 3, November 1993, entitled "Wideband and broadband digital 
i;::^ cross-connect systems generic criteria") stipulates the following requirement (R) 4-37: 

C3 "For a two-point unidirectional cross-connection, non-blocking cross-connection shall be 
' " provided. Non-blocking means that a cross-connection can be made regardless of other 

existing connections. Rearranging the existing cross-connections to accommodate a new 

cross-connection is acceptable only if the rearrangement is performed without causing any 

bit error for the rearranged cross-connections." 

The disclosures of all publications mentioned in the specification and of the publications 

cited therein are hereby incorporated by reference. 
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SUMMARY OF THE INVENTION 

The present invention seeks to provide methods and apparatus for expanding the capacity 
of a network. 

There is thus provided in accordance with a preferred embodiment of the present in- 
vention a method for increasing the total capacity of a network, the network including a 
::3 first plurality of communication edges (communication links) interconnecting a second plu- 
;S rality of communication nodes (transceivers), the first plurality of communication edges and 
y the second plurality of communication nodes having corresponding first and second plurali- 
f ties of capacity values respectively. The first and second pluralities of capacity values form 
ii corresponding topologies which determine the total capacity of the network. The method 
=P includes expanding the capacity value of at least an individual communication edge from 
among the first plurality of communication edges, the individual edge connecting first and 
;n second communication nodes from among the second plurality of communication nodes, 
Z without expanding the capacity value of the first communication node. 

In conventional methods, to expand total capacity, the capacities of at least a subset of 
nodes is expanded, plus the capacities of all edges and only those edges which connect a pair 
of nodes within that subset. 

There is thus provided, in accordance with a preferred embodiment of the present in- 
vention, a method for increasing the total capacity of a network, the network including a 
first plurality of communication edges interconnecting a second plurality of communication 
nodes, the first plurahty of communication edges and the second plurality of communication 
nodes having corresponding first and second pluralities of capacity values respectively, the 
first and second pluralities of capacity values determining the total capacity of the network, 
the method including expanding the capacity value of at least an individual communication 
edge from among the first plurality of communication edges, the individual edge connecting 
first and second communication nodes from among the second plurality of communication 
nodes, without expanding the capacity value of the first communication node. 

Further in accordance with a preferred embodiment of the present invention, the method 
includes performing the expanding step until the total capacity of the network reaches a 
desired level, and expanding the capacity values of at least one of the second plurality of 
communication edges such that all of the second plurality of communication edges have the 
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same capacity. 

Also provided, in accordance with another preferred embodiment of the present invention, 
is a method for expanding the total capacity of a network, the network including a first 
plurality of communication edges interconnecting a second plurality of communication nodes, 
the first plurality of communication edges and the second plurality of communication nodes 
having corresponding first and second pluralities of capacity values respectively, the first 
and second pluralities of capacity values determining the total capacity, of the network, the 
method including determining, for each individual node from among the second plurality 
of communication nodes, the amount of traffic entering the network at the individual node, 
and, for each edge connected to the individual node, if the capacity of the edge is less than 
the amount of traffic, expanding the capacity of the edge to the amount of traffic. 

Also provided, in accordance with another preferred embodiment of the present invention, 
is a method for constructing a network, the method including installing a first plurality of 
communication edges interconnecting a second plurality of communication nodes, and deter- 
mining first and second pluralities of capacity values for the first plurality of communication 
edges and the second plurality of communication nodes respectively such that, for at least 
one individual node, the sum of capacity values of the edges connected to that node exceeds 
the capacity value of that node. 

Further provided, in accordance with another preferred embodiment of the present inven- 
tion, is a network including a first plurality of communication edges having a first plurahty 
of capacity values respectively, and a second plurality of communication nodes having a sec- 
ond plurality of capacity values respectively, wherein the first plurality of communication 
edges interconnects the second plurality of communication nodes such that, for at least one 
individual node, the sum of capacity values of the edges connected to that node exceeds the 
capacity value of that node. 

Also provided, in accordance with yet another preferred embodiment of the present in- 
vention, is a method for allocating traffic to a network, the method including providing a 
network including at least one blocking switches, receiving a traffic requirement, and allo- 
cating traffic to the network such that the traffic requirement is satisfied and such that each 
of the at least one blocking switches is non-blocking at the service level. 

Further in accordance with a preferred embodiment of the present invention, the step of 
allocating traffic includes selecting a candidate route for an individual traffic demand, and, 
if the candidate route includes an occupied segment which includes at least one currently 
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inactive link, searching for a switch which would be blocking at the service level if the inactive 
link were activated and which has an unused active link which, if activated, would cause the 
switch not be blocking at the service level if the currently inactive link were activated, and if 
the searching step finds such a switch, activating the currently inactive link and inactivating 
the unused active link. 

The network may include a circuit switched network or TDM network or an ATM net- 
work. 

Also provided, in accordance with another preferred embodiment of the present invention, 
is apparatus for allocating traffic to a network, the apparatus including a traffic requirement 
input device operative to receive a traffic requirement for a network including at least one 
blocking switches, and a traffic allocator operative to allocate traffic to the network such that 
the traffic requirement is satisfied and such that each of the at least one blocking switches 
is non- blocking at the service level. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated from the following detailed de- 
scriptionj taken in conjunction with the drawings in which: 

Fig. 1 is a simplified flowchart illustration of a method for allocating traffic to a circuit 
switch blocking network; 

Fig. 2 is an illustration of a four node non-blocking ring network; 

Fig. 3 is an illustration of the adjacency matrix of the network of Fig. 2; 

Fig. 4 is an illustration of a network traffic requirement matrix for the network of Fig. 
2, which matrix satisfies non-blocking criteria; 

Fig. 5 is an illustration of an initial Unk state matrix showing initial network link states 
for the network of Fig. 2 for the traffic requirement matrix of Fig. 4; 

Fig. 6 is an illustration of an initial switch matrix for the traffic requirement matrix of 
Fig. 4; 

Fig. 7 is a simplified flowchart illustration of a method operative in accordance with one 
embodiment of the present invention for expanding a network by adding links as necessary 
to satisfy a given traffic requirement; 

Fig. 8 is an illustration of another network traffic requirement matrix for the network of 
Fig. 2; 

Fig. 9 is an illustration of a blocking configuration of the ring network of Fig. 2; 

Fig, 10 is an illustration of a link state matrix for the blocking ring network of Fig. 9; 

Fig. 11 is an illustration of the link state matrix for the ring network of Fig. 9 once the 
traffic requirement of Fig. 8 has been allocated thereto according to the method of Fig. 1; 

Fig. 12 is an illustration of the, switch state matrix for the ring network of Fig. 9 once 
the traffic requirement of Fig. 8 has been allocated thereto according to the method of Fig. 

1; 

Figs. 13 A &: B, taken together, form a simplified flowchart illustration of a method for 
allocating traffic to an ATM (asynchronous transfer mode) or TDM (time division multi- 
plexing) blocking network. 



Fig. 14 is an illustration of a four node non-blocking network; 

Fig. 15 is an illustration of an adjacency matrix for the network of Fig. 14; 

Fig, 16 is a traffic requirement matrix for the network of Fig, 14; 

Fig. 17 is an illustration of an initial hnk state matrix for the network of Fig. 14; 

Fig. 18 is an illustration of an initial switch state matrix for the network of Fig, 14 which 
satisfies the requirement matrix of Fig. 16; 

Fig. 19 is an illustration of another traffic requirement matrix for the network of Fig. 14 
which is impossible to fulfill; 

Fig, 20 is an illustration of a four node blocking network; 

Fig. 21 is an illustration of an initial link state matrix for the network of Fig. 20; 

Fig. 22 is an illustration of the network link state matrix for the network of Fig. 20, : 
following operation of the method of Fig, 17 on the net work of Fig. 20; 

Fig. 23 is an illustration of the switch state matrix for the network of Fig. 20 following 
operation of the method of Fig. 17 on the network of Fig. 20; 

Fig, 24 is a modification of the method of Fig. 7 suitable for ATM and TDM networks; 

Fig, 25 is an illustration of the network connections of a communication switch Vi attached 
to a site Si] 

Fig. 26A is an illustration of a network topology based on the 4-vertex clique C4, the 
numbers next to the links touching switch Vi indicate their capacities; 

Fig. 26B is an illustration of a routing scheme for C4 under a requirement matrix Rq, 
the numbers next to the links indicate the traffic flow they carry; 

Fig. 27 is an illustration of an expanded network after reconfiguring to fit the traffic 
requirements; 

Fig. 28A is an illustration of a routing scheme for the 4-vertex ring, each dashed arc 
. denotes a flow of 125 units; 

Fig. 28B is an illustration of a routing scheme for the 5-vertex ring, each dashed arc 
denotes a flow of 83 units; 

Fig. 29 is an illustration of a 21 node network example; 

Fig. 30 is an illustration of expanding a congested link e along the route; 
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Fig. 31 is an illustration of the link capacities after redistribution operation; 

Fig. 32 is an illustration of an ATM expansion network example; 

Fig. 33 is an illustration of the relationship between 6 and a(£^(CnjT)); 

Fig. 34 is an illustration of the relationship between $ and a(fe(Cn, r)); 

Fig. 35 is an illustration of the routing scheme from 5^ on the chordal ring; 

Fig. 36 is an illustration of the flow on the link {viyV2) on the 8- vertex chordal ring with 

Fig. 37 is an illustration of the routing scheme on the 3-chordal ring. 

Fig. 38 is a simplified functional block diagram of bandwidth allocation apparatus con- 
structed and operative in accordance with a preferred embodiment of the present invention; 
and - 

Fig. 39 is a simplified flowchart illustration of a preferred mode of operation for the 
apparatus of Fig. 38. 
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DETAILED DESCRIPTION OF PREFERRED 

EMBODIMENTS 

Reference is now made to Fig. 1 which is a simplified flowchart illustration of a method 
, for allocating traffic to a circuit switch blocking network. The method of Fig. 1 preferably 
comprises the following steps for each individual node pair in the blocking network. The 
method of Fig, 1 is performed repeatedly for all node pairs in the blocking network, using 
the same link matrix for all node pairs. The terms "link" and "edge'^ are used essentially 
interchangeably in the present specification and claims* 

Step 10 defines a loop. 

In step 20, the traffic demands are defined by a user. Typically, the traffic demand 
includes a quantity of traffic which is to pass between the two nodes in the node pair. 

In step 30, all routes are generated between the nodes in the node pair, e.g. by using 
the adjacency matrix of the network. Typically, in practice, all routes are generated which 
satisfy certain reasonableness criteria, e.g. which include less than a threshold number of 
hops. 

In step 40, the next best route is selected, based on suitable optimizing criteria such as 
cost. If more than one routes are equal in terms of the optimizing criteria, and if more than 
one demands are defined for the node pair (e.g. two demands of 155 Mb/s each for the same 
node pair) then typically each of these routes are selected simultaneously. 

In step 50, the hnk size of the next best route/s is reduced to indicate that that /those 
route/s is/are more occupied or even totally occupied due to the portion of the traffic that 
has been allocated to that/ those route/s. 

Step 60 asks whether the demand defined in step 20 has been satisfied. If so, the selected 
route or routes is/are activated (step 70) and the method returns to step 10 in which the 
same route-finding process is performed for the next node pair, continuing to use the same 
link matrix. 

If the demand is not satisfied, then, according to a preferred embodiment of the present 
invention, an attempt is made (step 80) to activate inactive links, if any, in order to allow 
the demand to be met without resorting to selection of less desirable routes in terms of the 



optimizing criteria. If no such inactive links exist, the method resorts to selection of less 
desirable routes in terms of the optimizing criteria by returning to step 40. 

If such inactive links exist, in occupied segments of the selected route/s, then it is assumed 
that activation of each of these inactive links would cause at least one switch along the 
selected route/s to block on the service level. A switch is considered to "block on the service 
level" if the traffic allocated to the routes entering the switch exceeds the traffic allocated to 
routes exiting the switch. It is appreciated that a blocking switch may nonetheless be found 
to be non-blocking on the service level. 

Preferably, if a plurality of links exist between a pair of switches, the links are assigned 
priorities by the user such that the lowest priority link is activated first and inactivated last 
and the highest priority link is activated last and inactivated first. If no priorities are defined, 
any inactive link may be selected for activation. 

In step 90, the method scans the switches along occupied segments of the selected route 
and tries to find a switch (or pair of switches) which is (are) preventing an inactive link from 
being activated and which has (or which each have) an unused active link. Some inactive 
links are prevented from being activated by only one of the switches they are connected to. 
In this case, only that switch needs to have an unused active link. Some inactive links are 
prevented from being activated by both of the switches they are connected to. In this case, 
each of the two switches needs to have an unused active link. 

If the test of step 90 is not passed, then the method returns to step 40, i.e. the method 
resorts to less desirable routes. 

If the test of step 90 if passed, i.e, if an inactive link exists along the occupied segments 
of the selected route which can be activated at the price of inactivating one or two adjacent 
active unused links, then the active unused link/s is/are inactivated (steps 95 and 100) 
and the inactive link is activated (steps 110 and 120) and the method then, according 
to one embodiment of the present invention, returns to step 30. Alternatively, in certain 
applications, the method may return to step 40 or step 50. 

A four node non-blocking ring network is illustrated in Fig. 2. The adjacency matrix 
of the network of Fig. 2 is illustrated in Fig. 3. The links connecting adjacent nodes in 
Fig. 2 each have a capacity of 155 Mb/s. The application is assumed to be a circuit switch 
application, i.e. the amount of traffic allocated to each used link may be exactly its capacity 
either as a single unit or as a product of smaller units whose total sums up to the link 
capacity. 
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The network of Fig. 2 is to be used to satisfy the network traffic requirement illustrated 
in Fig. 4. All of the switches in Fig. 2 are non-blocking because their capacities are 155 
Mb/s X 8 = 1.24 Gb/s, i.e. 8 times the link capacity (four incoming links and four outgoing 
links per switch, as shown). 

The initial link state matrix is shown in Fig. 5, where the first column indicates the two 
switches connected by each link, the second column the link's ID, the third column indicates 
the link's capacity, the fourth column indicates the current traffic allocation to each link, 
the fifth column indicates the extent to which the link is currently utilized^ the sixth column 
indicates the state of each link (active or inactive), and the seventh column indicates each 
link's priority for activation. 

It is appreciated that the network of Fig. 2 is non-blocking and remains non-blocking. 
However y the network of Fig. 2 cannot satisfy all the traffic requirements in Fig, 8. Therefore, 
the method of Fig. 1 is preferably employed in conjunction with the blocking network of 
Fig. 9. 

EXAMPLE 1: The method of Fig. 1 is now employed in an attempt to expand the 
network of Fig. 2 such that the network of Fig. 2 can support the traffic requirement of Fig, 
8 by using the blocking network of Fig. 9. 

The initial link state matrix for Example 1 is shown in Fig. 10. 

The operation of the method of Fig. 1 in this example is as follows : 

Step 10 - The node pair AjB is selected. 

Step 20 - According to Fig. 8, the traffic demands for the node pair A,B are 155 Mb/s 
+ 155 Mb/s + 155 Mb/s. 

Step 30 - There are two routes between A and B: A, B and A, D, C, B. 

Step 40 - The best route is A, B if a path shortness criterion of optimization is used. 

Step 50 - Demand is not satisfied because only two 155 Mb/s links are available between 
A and B whereas 3 are required, assuming the given requirement includes traffic which is all 
following a single route. Therefore, the link state matrix is not updated. 

Step 60 - The method proceeds to step 80. 

Step 80 - The occupied segment of the route is, in this case, the entire route* It is 
assumed that a 155 Mb/s unsatisfied requirement justifies adding a new link of size 155 
Mb/s from A to B. Therefore, the method proceeds to step 90. 
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Steps 90, 95 - Switches A and B are scanned and the method determines that LN3j LN4, 
LN5 and LN6 are active unused links and therefore, a link LNX9 of size 155 Mb/s can be 
added between switches A and B if links LN4 and LN6 are inactivated. 

Steps 100, 110, 120 - Links LN4 and LN6 are inactivated and deleted from the link 
state matrix. Link LNX9 is added to the link state matrix. In the switch state matrix, the 
utilized capacities of switches A and B are each incremented by 155 Mb/s because link LNX9 
has been added and are also decremented by the same amount because links LN4 and LN6 
respectively have been inactivated. Therefore, in total, the utilized capacities of switches A 
and B in the switch state matrix remain the same. 

The method now returns to step 30, 

In step 30, all routes are now generated for the current network configuration. The 
possible routes are now still A,B and A, D, C, B. 

Step 40 - The next best route is A, B as before. 

Step 50 - The demand is now satisfied so the link state matrix is updated by replacing 
the zero values in the first three rows of Link Utilization column 5 with values of 155 Mb/s. 

Step 60 - The method proceeds to step 70. 

Step 70 - The selected routes are activated and the method returns to step 10 and selects 
the next node pair. 

Step 10 - In the present example, the traflSc requirements are assumed, for simplicity, to 
be symmetric, and therefore the node pairs are, apart from A,B, only A, C; A, D;, B, C;, 
Bj D; and C, D. It is appreciated that, more generally, the traffic requirements need not be 
symmetric. 

In the present example, the next four node pairs to be selected are A, C; A, D;, B, C; 
and B, D respectively. Since the traffic requirement for each of these pairs is 0, the method 
of course finds that the demand is satisfied for each node pair trivially and proceeds to the 
last node pair, C, D. 

The method now proceeds to analyze the C, D node pair similarly to the manner in which 
the A, B node pair was analyzed- The method concludes, similarly, that a new link, LNXIO, 
of size 155 Mb/s, should be activated between switches C and D. In step 250, the demand 
is again deemed satisfied so the link state matrix is updated by replacing the zero values in 
the last three rows of Link Utilization column 5 with values of 155 Mb/s. 
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The final link state matrix is illustrated in Fig. 11. 

The blocking network of Fig. 9 may be generated by the method of Fig. 7 which is now 
described. 

Reference is now made to Fig. 7 which is a simplified flowchart illustration of a preferred 
method for expanding a network by adding links as necessary to satisfy a given traffic 
requirement. 

Steps 210 - 270 in the method of Fig. 7 are generally similar to steps 10 - 70 in the 
method of Fig. 1. 

In step 280, the method determines whether it is worthwhile to open new links (i.e. 
whether links should be added) within the occupied segment of the selected route, in ac- 
cordance with predetermined criteria of cost and/or utility for the proposed new link. This 
information is optionally received as an external input. 

If step 280 determines that it is not worthwhile to open any new links along the occupied 
segment of the selected routej the method returns to step 240 and selects the next best route 
because the current best route is not feasible. 

If step 280 determines that it is worthwhile to open a new link somewhere along the 
occupied segment of the selected route, the method proceeds to step 282. In step 282, the 
method inquires whether any of the proposed new links can be opened without causing any 
switch to block on the service level. If this is possible, these links are opened or activated 
(steps 310, 320). 

If, however, none of the proposed new links can be opened without causing some switch 
or other to be blocking on the service level, then the method proceeds to step 290 which is 
similar to step 90 of Fig. 1. If the test of step 290 is not passed then the method returns to 
step 240 and selects the next best route because the current best route is not feasible. 

If, however, the test of step 290 is passed then step 300 is performed which is generally 
similar to step 100 of Fig, 1. 

It is appreciated that the applicability of the method of Fig. 7 is not limited to circuit 
switch networks but includes all other types of networks such as TDM and ATM networks. 

Fig. 12 is an illustration of the switch state matrix for the ring network of Fig. 9 once 
the traffic requirement of Fig. 8 has been allocated thereto according to the method of Fig. 
1. 
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Reference is now made to Fig. 13 which is a simplified flowchart illustration of a method 
for allocating traffic to an ATM or TDM blocking network . 

The method of Fig. 13 is similar to the method of Fig. 1 with the exception that if a link 
is only partially utilized, it is possible to allocate to that Unk a proportional amount of the 
switch capacity, i.e. proportionally less than would be allocated if the link were completely 
utilized. In circuit switch applications, in contrast, the amount of switch capacity allocated 
to a link depends only on the link's capacity and not on the extent to which the link's 
capacity is actually utilized. 

A new step 400 is added before step 80 in which an attempt is made to identify partially 
utilized active links so that a larger proportion of these can be utilized. If all of the active 
links are totally utilized, i.e. if none of the active links are only partially utilized^ then the 
method proceeds to step 80. 

If there is at least one active link which is only partially utilized then the method proceeds 
to new step 410. 

In step 410, the method searches among switches along the occupied segment of the 
selected route which are preventing the partially utilized link or links from being further 
utilized. These switches are identifiable as those which are shown by the switch state matrix 
to be completely utilized. Among these switches, the method searches for those which 
have an active link which has unutilized bandwidth because the link is partially or wholly 
unutilized. If no such switch is found, the method returns to step 40 and selects the next 
best route since the current best route is not feasible. 

If, however, such a switch is found, the method proceeds to new step 420 in which the 
following operations are performed: 

The un-utilized bandwidth is "transferred" to where it is needed; and 

in the link state matrix, the link allocation column (e.g. Fig. 17, column 4), is incre- 
mented in the row which describes the link which is "accepting" the bandwidth. The link 
allocation column is decremented in the row which describes the link which is "contributing" 
the bandwidth. 

The method now returns to step 30. 

EXAMPLE 2: Given is a four node non-blocking network as illustrated in Fig. 14. 
Solid lines indicate physical links whereas virtual paths are indicated by dashed lines. The 
adjacency matrix of the network of Fig. 14 is illustrated in Fig. 15. The links connecting 
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adjacent nodes in Fig. 14, LNl to LN9j each have a capacity of 155 Mb/s. The application 
is assumed to be an ATM application. 

The network of Fig. 14 satisfies the network traffic requirement illustrated in Fig, 16. 
Assuming there are three input ports per switch, all of the switches in Fig. 14 are non- 
blocking. Specifically, the capacities of switches A, C and D are 155 Mb/s x 6 — 0.93 Gb/s 
and the capacity of switch B is 155 Mb/s x 12 = 1.86 Gb/s. 

The initial link state matrix is shown in Fig. 17, where the first column indicates 'the two 
switches connected by each link, the second column the link's ID, the third column indicates 
the link's capacity^ the fourth column indicates the current traffic allocation to each virtual 
Path Identifier (VPI) in a given link. The fifth column typically indicates the extent to 
which the link is currently utilized. The six column indicates the state of the link (active or 
in-active) and the seventh column indicates each link's priority for activation. 

The initial switch matrix for the above example is shown in Fig. 18 which satisfies the 
requirement matrix of Fig. 16. 

The network in Fig. 14 is non-blocking and remains non-blocking for the requirement 
shown in Fig. 16. However, the network of Fig. 14 cannot satisfy the additional traffic 
requirement of Fig. 19. Therefore, the blocking network of Fig. 20 is employed, initially 
carrying the traffic requirement of Fig. 16, and the link and switch states illustrated in the 
matrices of Figs. 17 and 18 respectively. In Fig. 20, existing links are indicated by thin lines 
and new expansion links are indicated by heavy lines. 

The method of Fig. 13 is employed in an attempt to expand the non-blocking network of 
Fig. 14 to function like the blocking network of Fig. 20 such that it can support the added 
traffic requirement of Fig. 19. The initial link state matrix, for Example 2 is shown in Fig. 
21. The initial switch state matrix for Example 2 is shown in Fig. 18. 

The operation of the method of Fig. 13 for this example is as follows: 

Step 10 ~ The node pair A, B is selected. 

Step 20 -T According to the traffic demand matrix of Fig. 19, the traffic demand for A, 
B is 100 Mb/s. 

Step 30 - all routes are generated for the current network configuration. The possible 
routes include only A, B. Therefore, 

Step 40 - The next best route is A, B. 
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Step 50 - No active links are available to satisfy the demand illustrated in the matrix of 
Fig. 21. 

Step 60 - Demand is not satisfied and the method proceeds to step 400. 

Step 400 - Yes, there are active links that can be utilized. Howeverj they can support 
only up to 155 Mb/s. Therefore, no active link with spare capacity is available and the 
method proceeds to step 80. 

Step 80 - Yes, there are links such as LNXlO'as shown in Fig. 21. The method proceeds 
==^ to step 90. 

U Step 90 - Switches A and B scan their links for inactive bandwidth that would enable 
activation of the LNXIO. Switch A has allocated three times 155 Mb/s, i.e. 465 Mb/s, 
y whereas only 300 Mb/s is utilized as shown in Fig. 21, column 6. Therefore, the inactive 
|j link can be activated with 100 Mb/s and the links LN2 and LN3 are allocated only 100 Mb/s 
each. The method now proceeds to step 95. 

3 Step 95 - No active link has been deleted so no update is needed. 

=^ Steps 100, 110, 120 update the link LN2 such that its VPI ID is 2 and its capacity is 
if 100, update the link LN3 such that its VPI ID is 3 and its capacity is 100, and update the 
2 link LNXIO such that its VPI ID is 4 and its capacity is 100. The switch matrix is updated 
accordingly and the method proceeds to step 30 to generate the routes. If, however, the step 
95 is not passe then the method goes to step 40 to try the next best route. 

Step 30 - All route are now generated for current network configuration. There is only 
one possible route: A, B. 

Step 40 - The next best route is A, B. 

Step 50 - LNXIO is available with 100 Mb/s. 

Step 60 - Demand is satisfied and the method proceeds to step 70. 

Step 70 - The path is realized and activated an the method proceeds to step 10 and 
selects A, C. 

The method proceeds to select the next traffic demand or requirements (step 10). The 
next node pair is A, C. The method preferably selects and tries to fulfill all remaining node 
pair requirements as shown in Fig. 19. 

The method satisfied the remaining requirements between B,C and B, D. The remaining 
requirement cannot be fulfilled, due to the network blocking. The network link states, 
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following operation of the method of Fig. 17 are shown in Fig. 22. Similarly, the node state 
matrix appears in Fig. 23, 

The method of Fig. 7 may be employed to add links in ATM and TDM networks, if 
step 290 in Fig, 7 is modified, as shown in Fig. 24, to additionally take into consideration 
partially utilized links when evaluating whether to add new links. Using Fig. 24, a blocking 
version of Fig. 14 is generated, as shown in Fig. 20. 

General capacity extended channels in communication networks provided in accordance 
with a preferred embodiment of the present invention are now described. This analysis 
wBS derived by Dr. Raphael Ben-Ami from BARNET Communication Intelligence Ltd, 
ISRAEL, and Professor David Peleg from the Department of Applied Mathematics and 
Computer Science, The Weizmann Institute of Science, Rehovot^ 76100 ISRAEL. Professor 
David Peleg is not an inventor of the invention claimed herein. 

A Introduction 

One of the basic rules used for governing the design of most traditional communication 
networks is the capacity conservation rule for the network switches. Simply stated, this rule 
requires that the total capacity of incoming communication links connected to a switch must 
not exceed the switch capacity. (As the outgoing communication links connected to the 
switch have the same total capacity as the incoming links, the same applies to them as well.) 
This rule is desirable since it serves to prevent blocking situations, in which the total amount 
of traffic entering the switch exceeds its capacity, and consequently blocks the switch. In 
fact, the requirement of non-blocking cross-connection is adopted in a number of standards 
(cf. [Bel93, Bel95]). 

The disadvantage of the capacity conservation rule is that it may in some cases cause poor 
utilization of the switch capacity. As long as traffic over the links entering and exiting the 
switch is well-balanced, the switch can be utilized up to its full capacity. However, if some 
of the incoming links are more heavily loaded than others (and the same for the outgoing 
links), then part of the switch capacity must remain unused. 

This paper proposes a more flexible approach to capacity conservation and blocking 
prevention. The idea is to allow a switch of a given capacity c to be physically connected 
to links with total capacity exceeding c. Capacity conservation, and subsequently blocking 
prevention, should be enforced by locking some of the capacity of each link, at any given 
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moment, and allowing it to use only part of its capacity. As the traffic pattern dynamically 
changes in the networkj usable link capacities can be changed. This is done by locking some 
of the currently free capacity in lightly loaded links, and at the same time releasing some 
of the locked capacity in highly loaded links. At all times, the usable portions of the link 
capacities must preserve the capacity conservation rule. 

This approach results in considerable improvements in the utilization of switches. Con- 
sider- the common situation in which increases in the traffic requirements have brought the 
network to the stage where the traffic currently saturates the capacities of the network 
switches, with some traffic requirements unsatisfied. In this case it is necessary to expand 
the network in order to accommodate this additional traffic. Designing the network upgrade 
while insisting on following the traditional capacity conservation rule would force the network 
designer to increase the capacity in both the switches and links in question. In contrast, by 
switching to our more flexible conservation rule, considerable gains in the amount of traffic 
may be possible in some cases, by adding capacity only to the links, and utilizing the current 
switch capacities more efficiently. 

(Let us remark that our approach is clearly beneficial also for the design of new networks. 
However, network expansions are increasingly becoming a more and more significant fraction 
of the market. This trend was identified in a recent study made by the Peiorus Group [Pel96]. 
According to this report, installations of expansion units in existing communication networks 
accounted for 40% of the installations of network units in 1996, and are expected to constitute 
the majority of the installations from 1998 on.) 

In what follows, we begin (in the next section) by formally defining the network model we 
rely on,, and then present formally the link expansion paradigm (in Section C). In Section D 
we provide some examples for the potential benefits in our approach. Section E presents the 
protocol used for dynamically controlling the available capacities of channels in the network 
as a function of continuous changes in the traffic patterns. Finally, Section F discusses the 
advantages of the proposed approach in ATM networks. 
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B The model 

B-l The network architecture 

The model can be formalized as follows. The communication network connects n sites, 
. . . , Sn* Each site Si is connected to the rest of the world via a communication switch, 
denoted Vi, The switches are connected by a network of some arbitrary topology. For the 
sake of generality, we assume that the links are unidirectional. Thus, each switch has a 
number of incoming links and a number of outgoing links. Formally, the topology of the 
network is represented by an underlying directed graph G = (V^E), where the vertex set 
V = {vi,,, .,Vn) is the set of switches the network, and E' C x V is the collection of uni- 
directional links connecting these switches (For notational convenience we may occasionally 
refer to the switch Vi simply as i, and to the link {vi.vj) as (z, j).)- 1^ addition, each switch 
Vi always has both an incoming and an outgoing link to its local site Sf, the site transmits 
(and receives) all its traffic to (and from) other sites through these two links. Let denote 
the set of these links. 

Formally, we will adopt the following notation concerning the link structure of a switch 
Vi. Denote the links connecting it to its site Si by (for the link from si to Vi) and eg^* (for 
the link from Vi to s^). We refer to these links as the site-switch links. Denote the remaining 
adjacent ingoing links of v by ef = {vuUj,) for 1 < Z < A:, and the adjacent outgoing links 

^out ^ {vi.Wjj) for 1 < Z < A:'. These links are referred to as the inter-switch links, or 
simply the network links. The link structure of the switch Vi is illustrated in Fig. 25. 

Let us now turn to describe another major factor of the network design, namely, the 
capacity of switches and links. Each link e = (i,i) has a certain capacity c{e) associated 
with it (In reality, it is often the case that the links are bidirectional and have symmetric 
capacity, namely, c(2,i) = c{j,i). Likewise, it may often be assumed that the requirements 
are symmetric, namely, r^j = r^-i.), bounding the maximum amount of traffic that can be 
transmitted on it from i to j. In addition to link capacities, each switch v of the network 
also has a capacity c{v) associated with it. 

The standard model assumes that the capacities assigned to the edges connected to any 
particular switch sum up to no more than the capacity of that switch. Formally, each switch 
must obey the following rule. 
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Capacity conser^ration rule: 

civ) > E c{et) = E 

0<l<k 0<l<k' 

We shall refer to a network obeying this conservation rule as a conservative network 

B.2 Traffic requirements and routing 

□ The traffic requirements among pairs of sites are specified by an n x n requirement matrix 
=2 R r= (ri^j), where r^j is the amount of traffic required to be transmitted from site Si to 
-J site Sj. (We will assume that traffic internal to the site Si, i.e., between different clients 
5 in that site, is handled locally and does not go through the network, hence in the traffic 
requirement matrix R to be handled by the network, r^^i — 0 for every i.) Note that the 
=P traffic requirements matrix R can change dynamically with time, as the result of new user 
•-^ requests, session formations and disconnections, and so on. 

\" Let us define the following notation concerning traffic requirements. For every site Si, 
ij denote the total traffic originated (respectively, destined) at Si by R^tii) — HjUj (resp., 
3 Ri^{i) = T.jrj,^^ Let Rsum{i) = Rout{i) + i?in(0- Fo^ each of the subscripts suh, let 
Rsub = xaByii{Rsub{i)]' 

A given requirements matrix R is resolved hy assigning to each pair of sites i,i a collection 
of routes from i to j, {p-j, . . . , pij}, over which the traffic r^j will be split. That is, each 
path p\ j will carry //j units of traffic from i to j, such that 

k 

i>i 

The collection of routes for all vertex pairs is denoted p. 

Once the routes axe determined, we know exactly how much traffic will be transmitted 
over each edge and through each switch of the network. Specifically, given a route collection 
p and a network element x eVuEuE' (which may be either an edge e or a switch v), let 
Q{x) denote the collection of routes going through x, 

Q{x) = {{iJJ) 1 X occui^ on p^^}. 

(Note that the switch v may never occur on a path as an end-point; all routes start and end 
at sites, and thus — formally speaking — outside the network.) Define the load induced by 
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p on the network element x ^V\jE\JE' (an edge or a switch) as 

(v\0€Q(a:) 

Observe that the traffic flows in Vi and its adjacent links must satisfy the following rule. 
Flow conservation rule: 

0<l<h 0<i<fc' 

Moreover, q{e^) = Rout{i) and gCeo""*) = Rin{i), and subsequently, 

l<i<A: l<l<k 

(these inequalities might be strict, since the switch Vi may participate in transmitting traffic 
belonging to other endpoints as well). Consequently, 

q{Vi) > Rin{i) 4- Rout{i) = Rsum{i)- (1) 

Clearly, in order for our link assignment to be feasible, the links and switches must satisfy 
the following rule. 

Flow feasibility rule: q{x) < c{x) for each link or switch x. 

In view of bound (2), this means that a requirement matrix R with Rsum > c cannot be 
satisfied at all, hence it suffices to consider matrices with Rsum ^ c (henceforth termed legal 
requirement matrices) . Call a requirement matrix R maximal if Rsum — namely, at least 
one of the switches saturates its capacity. Note that every matrix satisfying Rsum < c can 
be normalized so that it becomes maximal. Hence in what follows we shall concentrate on 
the behavior of networks on maximal requirement matrices. 



C The channel expansion model 

The idea proposed in this paper is to expand the capacity of channels beyond that of the 
switch. At first sight, this may seem wastefiil, as the potential traffic through a switch cannot 
exceed its capacity. Nonetheless, it is argued that such expansion may lead to increased 
total throughput under many natural scenarios, since allowing the total capacity of the links 
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adjacent to a switch v to be at most the capacity of the switch means that it is only possible 
to fully utilize the switch if the route d^tribution is uniform over all the links. In practice, 
a given traflRc requirement matrix may impose a non-uniform distribution of traffic over 
different links^ and thus force the switch to utilize less than its full capacity. Increasing the 
capacity of the links would enable us to utilize the switch to its fullest capacity even when 
the traffic pattern is non-uniform. 

It is important to note that the added channels need not be dedicated to potential 
expansion, but rather can be used for serving multiple functionalities in the network. For 
instance, the extra channel capacity can be used as protection lines, serving to protect 
against line failures. Moreover, some network designers are considering network with reserved 
bandwidth to reroute traffic in causes of failure. We claim that the expansion could be 
performed as well as considering bandwidth for reroute traffic in causes of failure. 

A potential difficulty with a naive implementation of this idea is that it might violate 
the highly desirable non-blocking property required of communication switches. In order for 
a switch to be non-blocking, it is required to ensure that whenever an incoming link has free 
capacity, both the switch itself and (at least) one of its outgoing links can match it with free 
capacity of their own. This guarantees that it is impossible for incoming traffic to ever "get 
stuck" in the switch. 

Hence in order to be able to utilize capacity expanded links, it is necessary to design 
the link-switch connection in a way that allows us to temporarily "lock" part of the link 
capacity, allowing the link to transmit only a fraction of its real capacity. Then, whenever 
a switch of capacity c is connected to Unks whose total capacity is c' > c, it is necessary to 
lock the extra link capacity, to a total ofd-c capacity units, and allow only a total capacity 
of c units to reach the switch. 

Obviously, in order to enable us to take advantage of the extra capacity, the link locking 
mechanism must be reconfigurable, namely, allow changes in the firaction of locked capacity. 
This will allow the capacities of the links connected to a particular switch to be dynamically 
reconfigured at any given moment, according to the changes in traffic requirements. We will 
describe a protocol for dynamically controlling link capacities in the network in Section E. 

Let us next present a formal definition for a communication network model supporting 
expanded capacity channels. The main change is that the capacity of each link e, c(e), is 
partitioned at any given time t into two parts, namely, the usable capacity c^(e) and the 
locked capacity c^(e). These two quantities may change over time, but at any given time t 
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they must satisfy 

At time t, the only part of the capacity that can be used for transferring traific is the usable 
capacity; the locked part is effectively disconnected jfrom the switch (by software means, 
although it is still physically attached to the switches), and cannot be utilized for traffic. 
That is, denoting the load on the link e at time ^ by g*(e), the flow feasibility rule for links 
becomes: 

* Modified flow feasibility rule: At any given time g*(e) < c^(e) for each link e. 

•2 The capacity conservation rule observed by the switches must also be modified now, so 
that it refers only to usable capacitj^ 

Modified capacity conservation rule: At any given time t, 
^ civ) > E = E 

3 0<l<k 0<l<k' 

u D Examples for potential benefits 

Let us illustrate this idea via a number of simple examples. In these examples, the traffic 
pattern is semi-rigid, in the sense that the system remains under one traffic requirements 
matrix R for an extended period of time, and while this matrix is in effect, the traffic 
values behave precisely as prescribed by it (i.e., there are no significant traffic fluctuations). 
That is, traffic volume changes occur sparsely. Later on, we will discuss the way we handle 
dynamically changing systems. At this stage, let us only point out that it is clear that in 
a dynamic setting, the potential profits fi:om the utilization of dynamic capacity expansions 
are even greater than in the semi-rigid setting. 

D,l Paired traffic on the 4-node clique 

Consider the complete network over four switches, vi to i?4, connecting the sites si to 54. 
Suppose that the capacity of each switch is 600, and that the network obeys the conservative 
model, allocating the link capacities as in Fig 26 (a). 

Suppose that at a given moment, it is required to establish communication of total volume 
600 from vi to V2 and from V4 to vz- In the given network, at most 100 units of the traffic 
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from vi may proceed on the direct link {vi, V2)j and the rest (in two equal parts of 50 units 
each) must follow paths of length 2, via the other two vertices. The same applies to the 
traffic from V4 to ^3. Once this is done, all the edges leading from vi and '^4 to V2 and are 
saturated (see Fig. 26 (b)). 

In this case, if the network consists of capacity-expanded links, say, with capacity c(e) = 
600 for each link, then it is possible to route all requested traffic by reconfiguring the network 
so that the admissible capacities are as in Fig. 27. 

i5 D*2 Uniform traffic on small ring networks 

\0 Next, we consider the effects of expansion on ring networks of four and five nodes. Assume 
iiO that the node capacities are 1000 units, traffic is uniform and network link capacities are 250 

units each (i.e., the site-switch links have 500 unit capacities). Also assume that each node 

is required to send each other node a total of 167 units. Calculations presented elsewhere 
m [BP96b] show that in the conservative setting (i.e., with no link expansion), only 3/4 of 

this traffic, i.e., /^j = 125 for every 1 < < 4, can be transmitted. At this point, the 
i;if trajBBc saturates the inter-switch links, whose capacity is 250 units, (See Fig. 28(a)), Hence 
f i this traffic pattern causes a blocking of 25%, In contrast, expanding the ring network by a 

factor of 8/7, namely, increasing the link sizes to 286 units, will reduce the blocking to 14%, 

allowing a traffic of fij = 143 for every 1 < ij < 4. 

Now consider the 5- vertex ring, under the same assumptions on capacities and traffic 
requirements. In the conservative model we have 33% blocking, with fij = 83 for every 
1 < i^ j < 5. (See Fig. „28(b).) However, assuming the links are expanded by a factor of 
6/5, i.e., their capacity becomes 300, it becomes possible to transmit 4/5 of the traffic, i.e., 
fi^j = 100 for every 1 < ij < 5, hence the blocking is reduced to 20%. 

D.3 Uniform traffic on a 21-node general network 

In the following example (see Fig. 29) we consider a larger network of 21 nodes, with 
each node connected to four other nodes. We assume a uniform traffic requirement matrix 
betw:een the nodes, with each node sending 126 units of traffic to every other node. Further, 
we assume that the node capacity is 5040, and the capacity of each network link is 630 units 
(leaving 2520 units for the capacity of site-switch links). In the conservative setting, it is 
shown in [BP96b] that only 35 units can be sent between every pair of nodes {fij ~ 35 units 
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for every I <ijj < 20), as at that point the traffic saturates at the inter-switch link, whose 
capacity is 630 units. This means that 72% of the traffic is blocked. 

This network can be expanded by increasing the network link capacities to 1296 units. 
This would enable each node to send up to 72 units of traffic to every other node, thus 
reducing the blocking to 43%. 

E Dynamic capacity expansion control 

^ In this section we describe our approach to the problem of dynamically controlling the 
y available capacities of channels in the network as a function of continuous changes in the 
5 traJS&c patterns. Specifically, we give a schematic description of a protocol whose task is to 
1! control the capacity expansions and reductions of channels in the network in response to 
F dynamic requests for session formations or disconnections. 

:S The capacity control protocol is in fact integrated with the route selection method used 
by the system. The method responds to connection requests issued by end users. Each such 

y request includes the identities of the two endpoints, and a volume parameter representing 
the traffic volume expected to be transmitted between these endpoints (and hence, the size 
of the requested bandwidth slice). 

Let us start with a high-level overview of the method. A new connection request a — 
{si,Sj,r), representing two end users firom sites Si and Sj requesting to form a session with 
r units of bandwidth, is handled as follows. First, a procedure PathGen is invoked, whose 
task is to generate candidate paths. Of those candidates, we then select a preferred route 
according to pre-specified optimization criteria. The choice of criteria is the subject of much 
discussion in the literature, and there is a wide range of design choices that can be made 
here, and are largely independent of our scheme, so we will make no attempt to specify them 
here. One parameter that is not taken into consideration at this stage, though, is feasibility. 
Namely, the protocol does not try to verify that the selected route has sufficient capacity at 
the moment in order to meet the entire demand specified by the request. 

The selected route is now allocated to this session. At this point, the method checks to 
see what part of the request has been fulfilled. In case there is still an unsatisfied fraction of r' 
units, the method now tests to see whether it is possible to expand the congested segments of 
the selected route by the required amount. The congested segments of the route are defined 
as those links along the route whose flow is currently identical to their usable capacity. 
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Expanding the capacity of such a congested link e is done as follows. Suppose that e 
connects the vertices Vi and V2 along the selected route from Si to Sj, Suppose further that 
there exist some unsaturated edges emanating from Vi, i.e., edges whose current load is less 
than their usable capacity, and some unsaturated edges entering V2* 

Let Ai denote the total "free" (namely, usable but currently unused) capacity in the un- 
saturated outgoing links oivi, and let A2 denote the total "free" capacity in the unsaturated 
ingoing links of Let 

A-min{Ai,A2,r',c*^(e)}. 

We will only expand the capacity of e by A units. This is done as follows. First, unlock A 
units of capacity on link e, setting c^(e) -f- c\^{e) — A and c^(e) -f- Ci;{e) -f A, At the same 
time, balance the capacities at the switches vi and V2 by locking A units of capacity in the 
unsaturated outgoing edges of vi and in the unsaturated ingoing edges of V2. Clearly, the 
conservation rules are maintained, and link e is now able to transmit A additional traffic 
units. 

Of course, the traffic increase along the route depends on the least expandable link, 
namely, the link e for which A is smallest. If that A is strictly smaller than r', then the 
selected route cannot be expanded any more, and part of the traffic must be routed along 
some alternate routes. 

Example: We illustrate the expansion process via an example, depicted in Fig, 30. In 
this . example, the total capacity of network links is 12 units. The link e is congested as 
g*(e) = c^(e) = 9, but it still has some locked capacity (c^(e) = 3). Suppose that = 2, i.e., 
two additional units of flow are needed along the route from Si to Sj, The only unsaturated 
edge emanating from '^i is the edge ei, for which Ci;{ei) = 10 and q^{ei) = 8. The only 
unsaturated edge entering V2 is the edge 62, for which Ci;{e2) == 10 and 9^(62) = 5. 

Under these assumptions, Ai — 2 and A2 = 5, and hence A = 2. Therefore, on e, 
it is possible to unlock 2 capacity units, thus setting c];^{e) ^ 1 and c^(e) ^ 11. For ei 
and 62 this entails setting c[(ei) c£(e) + 2, c^(ei) ^ 4/{e) ~ 2, 0^(62) ^ c^(e) + 2 and 
^^(^2) ^ ^ui^) 2- The resulting capacity distribution is depicted in Fig. 31, 
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F ATM Network Expansion 

In an ATM network, a virtual path connection (VPC) is a labeled path which can be used 
to transport a bundle of virtual channel connections (VCC's), and to manage the resources 
used by these connections. Using the virtual path concept, the network is organized as a 
collection of VPC's which form a VPC, or a logical overlay network. Generally, the VPC can 
be either permanent or semi-permanent, and have a reserved capacity of the physical links. 
VPC provisioning activities include VPC topology and VPC capacity allocation decisions. 
VPC is defined in the standard [ITU], and plays a significant role in both traffic control 
and network resource management. Some of the main uses of the virtual path concept are 
for achieving simplified routing, adaptability to varying traffic and network failures through 
dynamic resource management, simple connection admission, and the ability to implement 
priority control by segregating traffic with different quality of service. 

The extent to which VPC provisioning is able to improve efficiency is highly dependent 
on its ability to provide VCC's with low setup and switching costs, while maintaining low 
blocking probability for the required network connectivities. This, in turn, depends on the 
VPC topology and capacity allocation from resource management decisions. 

In particular, the choice of VPC topology, or layout, greatly impacts the connection setup 
and switching costs, the network's resilience to unexpected traffic conditions and components 
faaures, as well as the ability to change the topology when required. Generally, the VPC 
topology is affected by the physical network. 

A main characteristic property of ATM networks that differentiates it firom our previous 
model is the following. In an ATM network, two nodes A and B may be connected by a 
number of communication links (typically of the same type and capacity). However, each 
VPC must be allocated in its entirety via a single link along each segment of the path, i.e., 
splitting a VPC between two or more links is forbidden. (On the other hand, note that a 
given link can have several VPC's.) 

This property affects the issue of capacity allocation discussed earlier, and complicates 
the derived solutions, particularly with regard to blocking. For instance, suppose that each 
of the links connecting the nodes A and B has fewer than X units of free capacity. Then 
a new VPC request requiring X capacity units cannot be accommodated, despite the fact 
that the total free capacity between A and B is much greater than needed. 

This problem can be alleviated by expanding communication channels beyond the switch 
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capacities. Such expansion can be achieved by adding some extra communication Hnks. It is 
then possible to utilize extra space by i&xing the usable capacity of each link to be precisely 
the used capacity, and locking the remaining capacity, thus freeing the available capacity of 
the switch for use via other links. 

Let us illustrate this point by an example. Fig. 32 describes a four node ATM network^ 
where each node has three links connecting to the neighboring nodes as shown. In the setting 
depicted in the example, each link emanating from node A belongs to sole* VP. We assume 
that each link capacity is 155 Mb/s and the node capacity can support up to twelve 155 
CD Mb/s links. Therefore each node is assigned three site-switch links and three links for each 
JiJ inter-switch connection it is involved in. (Hence the capacity of the links touching node B 
' 4 equals the node capacity, and the other nodes have superfluous capacity at the switches.) 

m Assume a traffic requirements matrix by which Node A has to send 100 Mb/s to each of 
the other three nodes B, C and D. Therefore, bandwidth allocation for these demands will 
result in the allocation of 100 Mb/s to VPl, VP2 and VPS. Note that a new request for a 

y forth VPC of 100 Mb/s between any node pair cannot be satisfied, due to the non-splitting 
constraint on VPC's, despite the fact that sufficient capacity is available within the links to 

rU support all the demands. This will cause blocking in the network, which in the worse case 

• f can reach up to 30% of the network connectivity. 

We resolve the blocking problem by expanding the network via adding a link (or several 
links) between any two connected nodes. These new links could utilize the remaining unused 
bandwidth for accommodating a new connection request. This is done by locking the usable 
capacity in the links serving the initial three VPC's on their currently used capacity of 100 
Mb/s, and allocating free usable capacity in the amount requested to the new VPC over the 
currently unused links. 

References 

[Bel93] Wideband and broadband digital cross-connect systems - generic criteria, Bell- 
core, publication TR-NWT-000233, Issue 3, November 1993. 

[Bel95l ATM functionality in SONET digital cross-connect systems - generic criteria, 
Bellcore, Generic Requirements CR - 2891-CORE, Issue 1, August 1995. 



28 



) 



} 



[BP96a] R. Ben- Ami and D. Peleg. Analysis of Capacity-Expanded Channels in a Com- 
plete Communication Network. Manuscript^ 1996. 

[BP96b] R. Ben-Ami and D. Peleg. Capacity-Expanded Channels in Communication 
Networks Under Uniform Traffic Requirements, Manuscript, 1996. 

[Pel96] The Pelorus Group. Digital Cross-Connect Systems Strategies, Markets & Op- 
portunities - Through 2000. Report, November^ 1996. 

[ITU] ITU-T Rec. 1-375. Traffic Control and Congestion Control in B-ISDN. July 

1995. 

Computational relationships in capacity-extended channels in communication networks 
generally provided in accordance with a preferred embodiment of the present invention are 
now described. This analysis was derived by Dr. Raphael Ben-Ami from BARNET Com- 
munication Intelligence Ltd, ISRAEL, and Professor David Peleg from the Department of 
Applied Mathematics and Computer Science, The Weizmann Institute of Science, Rehovot, 
76100 ISRAEL. Professor David Peleg is not an inventor of the invention claimed herein. 

G The network model 

The model can be formalized as follows. The communication network connects n sites, 
5i, . . , , Sn- The traffic requirements among pairs of sites are specified by an n x n requirement 
matrix R = (r^j), where r^j is the amoxmt of traffic required to be transmitted from site Si 
to site Sj, (We will assume that traffic internal to the site Sj, i.e., between different clients 
in that site, is handled locally and does not go through the network, hence in the traffic 
requirement matrix R to be handled by the network^ r^^j = 0 for every i.) 

Let us define the following notation concerning traffic requirements. For every site 5^, 
denote the total traffic originated (respectively, destined) at Si by RouS) ~ Hjnj (resp., 
Rin{i) = Ei^i,f)- Let Rsum{i) = Rout{i) + Rin{i)' For each of the subscripts sub, let 
Rsub = m3;Xi{Rsub{i) } - 

Each site 5^ is connected to the rest of the world via a communication switch, denoted 
Vi. The switches are connected by a network of some arbitrary topology. For the sake of 
generality, we assume that the links axe unidirectional. Thus, each switch has a number of 
incoming links and a number of outgoing links. Formally, the topology of the network is rep- 
resented by an underlying directed graph G == (V, E), where the vertex set V = {t;i, . , . , Un} 
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is the set of switches the network, and C y x y is the collection of unidirectional links 
connecting these switches (for notational convenience we may occasionally refer to the switch 
Vi simply as i, and to the link {vi.Vj) as [ij)^)^ In addition, each switch Vi always has both 
an incoming and an outgoing link to its local site Su the site transmits (and receives) all its 
traffic to (and from) other sites through these two links. Let denote the set of these links. 

A given requirements matrix R is resolved by assigning to each pair of sites j a collection 
of routes from i to j, {p^j,. . • over which the traffic will be split. That is, each 

path p\j will carry flj units of traffic from i to such that 

Jc 

fl The collection of routes for all vertex pairs is denoted p. 

U Once the routes are determined, we know exactly how nrnch traffic will be transmitted 
over each edge and through each switch of the network. Specifically, given a route collection 
:;:3 p and a network element x eVU EUE^ (which may be either an edge e or a switch v), let 
Q{x) denote the collection of routes going through x, 

Q(x) = {(iJJ) I X occurs on p[j}, 

(Note that the switch v may never occur on a path as an end-point; all routes start and end 
at sites, and thus — formally speaking — outside the network.) Define the load induced by 
p on the network element x eVU EuE' (an edge or a switch) as 

E 4- 

(ij,OeQ(i) 

Consider a switch Vi. Denote the links connecting it to its site Si by Cq" (for the link from 
Si to Vi) and eg"* (for the link from Vi to Si). Denote the remaining (network) adjacent ingoing 
links of V by ef = (vi.ity,) for 1 < / < A;, and the adjacent outgoing links by ep* = (vi^Wj^) 
for 1 < Z < fc' (see Fig. 25), 

Observe that the traffic flows in Vi and its adjacent links must satisfy 

0<i<ife 0<i<A;' 

Moreover, q{e^) = Routi'i) and q{e^^) = Rin{i), and subsequently, 

E ^ and E 9(0 > Routii) 

l<l<k l<l<k 
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(these inequalities might be strict, since the switch Vi may participate in transmitting traffic 
belonging to other endpoints as well). Consequently, 

q{Vi) > Rin{i) + Rout{i) = Rsum{i)' (2) 

Let us now turn to describe another major factor of the network design, namely, the 
capacity of switches and links. Each link e = (i, j) has a certain capacity c{e) associated 
with it (in reality, it is often the case that the links are bidirectional arid have symmetric 
capacity, namely, c(;ij) = c{j,i). Likewise, it may often be assumed that the requirements 
rS are symmetric, namely, r^j = r^-,i,), bounding the maximum amount of traffic that can be 
ffl transmitted on it from i to j. In addition to link capacities, each switch v of the network 
, also has a capacity c{v) associated with it. 

! Clearly, in order for our link assignment to be feasible, each link or switch x must have 
IE at least q{x) capacity. In view of bound (2), this means that a requirement matrix R with 
L Rsum > c cannot be satisfied at all, hence it suffices to consider matrices with Rsum < c 
m (henceforth termed legal requirement matrices). Call a requirement matrix R maximal if 

Rsum = c, namely, at least one of the switches saturates its capacity. Note that every matrix 
[5 satisfying Rsum < c can be normalized so that it becomes maximal. Hence in what follows 

we shall concentrate on the behavior of networks on maximal requirement matrices. 

The standard model assumes that the capacities assigned to the edges connected to any 
particular switch sum up precisely to the capacity of that switch, namely, 

Q<l<k 0<l<k' 

We shall refer to a network obeying this conservation rule as a conservative network, 
G.l The channel expansion model 

The idea proposed in this paper is to expand the capacity of channels beyond that of the 
switch. At first sight, this may seem wasteful, as the potential traffic through a switch cannot 
exceed its capacity. Nonetheless, it is argued that such expansion may lead to increased 
total throughput under many natural scenarios, since allowing the total capacity of the links 
adjacent to a switch v to be at most the capacity of the switch means that it is only possible 
to fully utilize the switch if the route distribution is uniform over all the links. In practice, 
a given traffic requirement matrix may impose a non-uniform distribution of traffic over 
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different links, and thus force the switch to utilize less than its full capacity. Increasing the 
capacity of the links would enable us to utilize the switch to its fiillest capacity even when 
the traffic pattern is non-uniform. 

Let us illustrate this idea via a simple example. Consider the complete network over 
four vertices, vi to v^. Suppose that the capacity of each switch is c, and that it is required 
to establish communication with total volume c from Vi to In the basic conservative 
network, the capacity of each of the links is only c/3, and therefore at most c/3 of the traffic 
from Vi may proceed on the direct link [vi^v^), and the rest (in two equal parts of volume 
Q c/3 as well) must follow paths of length 2, via the other two vertices. Once this is done, the 
It! vertices Vi and V2 have already utilized all of their capacity, while the vertices V2 and Vz have 
''4 already utilized c/3 of their capacity, so less is left for other traffic. In contrast, if the links 
1 y were allowed to have greater capacity, say, c, then it would have been possible to send all 
rU traffic from vi to on the direct link between them. This would still exhaust the capacity 

at vi and V4, but leave V2 and '^3 unused, with all of their capacity intact. 
^3 To illustrate the profit potential of the channel expansion approach, we analyze the 
1;V increase in throughput in a the following model. Given a network H, with its switch and Unk 
m capacities, define the 9-expanded network over H, denoted £e{H), by uniformly expanding 
\i (naturally, nonuniform expansions should be considered as well, but we leave that for future 
study.) the capacity of each Unk e to ^ - c(e). We will try to evaluate the transmission 
capability of the ^-expanded network Se{H) w.r.t. the basic conservative network H, for 
9 > 1 (for ^ = 1 the two networks coincide). 

To evaluate the transmission level of a given network we will use the following parameter. 
For a network H and a requirement matrix R, define the R-transmission quality of H on R 
as 

a{H, R) = maxja > 0 | requirement matrix a • R can be satisfied on i?}, 
where a • i2 is the requirement matrix (a • r^j), namely, multiplying the requirement nj for 
every pair i,j by a. 

Observe that for a maximal requirement matrix R, 0 < a{H,R) < 1. Intuitively, the 
better the network i?, the greater a{H,R) is. Hence we will be interested in the value of 
a{H, R) for the worst possible J?. This leads to the following definition. For a network J?, 
define the transmission quality of as 

a{H)^ min {a{H,R)}, 

R 

For a conservative network F, it is natural to compare the transmission quality of the 
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^-expanded network £g{H) with that of H, and examine the improvement in this quality due 
to the expansion. For the network H and the expansion factor 6, we define the improvement 

MH)= max 

I.e., jeiH) measures the maximum gain in transmission quality due to expanding the link 
capacity of the conservative network if by a factor of 9. Clearly, this factor is always at least 
1, and the higher it is, the more profitable it is to expand the capacity. 



H Restricted comparative model 

Let us start by analyzing the potential gains from the expansion of link capacities in a 
restricted and simplified model. We will consider a conservative network [based on a A- 
regular n- vertex undirected graph G (with each edge composed of two unidirectional links, 
one in each direction). We will further assume that the switch capacities are uniform, namely, 
each of the vertices has capacity c. Similarly, we will assume that all network links are of 
the same capacity. More precisely, given a fioced parameter 0 < r < 1, it is assumed that 
for every switch Vi, the links eg"* and ef connecting it to its site Si are of capacity (1 - t)c, 
and every network link (connecting switch Vi to switch Vj) is of capacity re/ A. Denote 
the resulting conservative network over the underlying graph G (with the switch capacities 
determined by the parameter r) by B{G,t). Denote the ^-expanded network over B{G,r) 
by 5s(G,r), 

The natural extremal point for the expansion parameter 5 is at ^ = A/r, as the initial 
capacity of interswitch links in B{G, r) is rc/ A, and it is pointless to expand the capacity 
of a link beyond c. 

In this section we will focus on studying the properties of 5a(G,r) for the complete n- 
vertex network G = Cn- Observe that for 9 = A/r = (n - l)/r, the network £n-i{Cn,r) 
is capable of satisfying every legal requirement matrix, and hence in particular every max- 
imal matrix, since for every i and j, the traffic r^j from i to j can be transmitted (exclu- 
sively) on the direct link connecting them. Consequently a{S(n-ii/r{Cn, r)) = 1, and hence 
7(n-i)/r(Cn,r) = 1/ a{B{Cn,r)) . Hence to evaluate 7(n-i)/r(C„,r) we shall need to derive 
bounds on a{B{Cn,r)). More generally, we will now derive some (upper and lower) bounds 
on a(5fl(C„, r)) for values of 1 < 5 < (n - 1)/t. 
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H.l Upper bound 

Lemma H.l The transmission quality of the d-expanded network Se{Cn^ r) is bounded above 
as follows. 



L For every r > 2/3^ 

a{Se{Cn,T)) < 

2. For every r < 2/3, 

a{£e{Cn,r)) < 



2 , _r0_ 
L 3 ~ 3(n-l) ' 



2 



3(n-l) ' — 3(l-r) • 



3 3{n-l) ' ^ ~ Zt • 



Proof: To prove the lemma, we have to show that there exists a maximal requirement matrix 
iZ, such that if the 6^-expanded network Se{Cn, r) can satisfy the traflEic matrix a • R, then a 
is bounded above as in the lemma. 

Assume n is even, and consider the following requirement matrix Rm based on a matching 
among the sites {2% — 1,2%) for 1 < i < n/2, with requirement c from 2i — 1 to 2i. I.e., 
7*1,2 — ^3,4 — ... — ^Ti-i,n ~ <^ and rij = 0 for all other pairs. This is a maximal matrix (in 
particular, for every odd vertex, J2out(2i - 1) = c, and for every even vertex, Rin{2i) = c). 
We consider the traffic requirement matrix a - Rioi some constant 0 < o; < 1. 

Let us examine the way in which this traffic requirement can be satisfied on the 9- 
expanded network £e(Cn,r) for some fixed 0 < r < 1. In particular, consider the traffic 
from 2i — 1 to 2i, for some 1 <i < n/2. A first immediate constraint on this traffic is that it 
must be transmitted from the site 52i-i to its switch V2i^i (and likewise, from the switch V2i 
to its site S2i), and therefore the capacity of effli and e^^ must exceed ac, i.e., ^(l-r)c > ac, 
or 

a < d{l-T). (3) 

The volume of traffic that can be transmitted on the direct link from 2i - 1 to 2i is at 
most its capacity, 9rc/{n — 1). All the remaining traffic must follow alternate routes, which 
must consist of at least two links and hence at least one additional intermediate switch. 



34 



Let qvii) denote the load (i.e., the total amount of traffic volume used) at all switches 
as a result of the traffic from 22 — 1 to 2i, Then 

qv{i) > (3a - er/(n - l))c, 

as a volume of a • r2i~i^2i = Oic is used at each of the endpoints 2i - 1 and 2i, and in addition, 
a traffic volume of at least ac - drc/in - 1) goes through alternate routes of length two or 
more, and hence must occupy at least one more switch. 

Denoting the total volume used in switches for transmitting the matrix Rm by qv and 
noting that this value is bounded by the total switch capacities, we get that 

nc > qv = E^vW > |(3a-er/(n-l))c. 

i 

This gives us the following bound on or: 

Next, let us derive a bound on a based on link capacities. Consider the directed cut in 
the network sepai-ating the odd vertices from the even ones. The total capacity of the cut 
(in the direction from the odd to the even vertices) is (f)^ On the other hand, the total 
traffic requirements on this cut (from odd to even vertices) are f • ac. Therefore, we must 

have 2 

aca ^ drcTT 



2 - 4(n - 1) ' 

hence a < ern/2{n - 1). Fixing 9 and r and taking n to infinity we get the following bound 

on a: ^ 

a < y. (5) 

The bounds expressed by inequaUties (3) and (5) coincide when r^ljZ. In case r < 2/3, 
the bound expressed by inequality (3) is dominated by that of inequality (5), Finally, in case 
r > 2/3, the. bound expressed by inequality (3) dominates that of inequality (5). Hence the 
bounds specified in the lemma follow. | 

The relationship between the expansion factor 9 and the transmission quality measure 
a(5g(C„)) are expressed in the graphs of Fig. 33. Here 

>2/3 , 



_ f 1-r , r > 
- \ r/2 , r < 2/3 , 
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and 



3(l-r) 



'break — 



3t 



r < 2/3 , 



H.2 Lower bound 



Lemma H.2 The transmission quality of the 9-expanded network 6e{Cn, r) is bounded below 
as follows. 



1. For every r > 2/3, 



' 9{1~t) , 1<9< 



3(l-r) 



I 3 ^ 3n-5 ' — 3{1-t) 



S. For etierj/ r < 2/3, 



^r/2 , l<e<^, 



a{£g{Cn,r)) > 



3 2(3n~5) ' ^ — 



3t 



Proof: Consider the ^-expanded network £0{Cn,r) over the complete graph Cn for some 
fixed T and 0, To prove the lemma^ we need to show that for every maximal requirement 
matrix R, Se{Cn^ r) can satisfy a traffic matrix a • i?, where a is bounded below as in the 
lemma. Let R be given. Observe that in order for a site i to be able to send_out the traffic 
it is required to send, we must have aRouti^) ^ ^0- aRin{i) < d{l " '^)^* 

Rsum S it is clear that in order to satisfy these two requirements it suffices to ensure that 



(6) 



We select the routing as follows. For every pair {hj), the requirement avij from i to j will 
be transmitted as follows. Let x and y be parameters to be fixed later. First, a slice of 
volume XTij will be transmitted over the direct edge between them. In addition, for every 
switch k ^ {ij}, a traJSic slice of volume yrij will be transmitted over the length-2 path 
from i to to 

Let us now identify the requirements that ar, y and a must satisfy in order for the specified 
routing to be valid. First, for every i and the total traffic volume transmitted from i to j, 
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which is XTij + {n- 2)yri^j, must exceed the requirement ary, hence we get 

x + {n-2)y> a. 



(7) 



Next, we need to ensure that the prescribed paths do not exceed the switch and link 
capacities available to the network. Let us first consider a switch k, and calculate the traffic 
volume going through it. This traffic first includes traffic for which k is an endpoint, of volume 
aRs„m{k) <• ac. In addition, the total traffic volume going through k as an intermediate 
switch is T.i,i^kyn^- Letting Z = Eij/fe^'i,j, we note that 

:i ^ = E E = E(^o«*(^) - ^^-*) = E Routii) - E ^i," = E Routi^ - ^-(^)- 

i By a similar argument we also have Z = Y^a^k^ni^) - Rout{k). Put together, we get that 

Z = ifE-R--W-^--wl ^ |E^-m(i) < < (n-l)c/2. 

Therefore the total traffic in the switch is bounded by y^" + ac = {y{n - l)/2 + cx)c, and 
ill it is necessary to ensure that- this vohime is smaller than the switch capacity, which is c, 
; namely, that 

= ^ y{n - l)/2 + a < 1. (8) 

Finally, we need to ensure that the prescribed paths do not exceed the link capacities 
available to the network. Consider a link e = and calculate the traffic volume going 
through it. This traffic first includes a volume of xnj of direct traffic from Si to sj. In 
addition, for every other switch A;, the link e transmits traffic of volume yrkj along a route 
from k to j, and traffic of volume yri^k along a route from i to k. Thus the total volume of 
traffic over e is 

= {x-2y)rij + y{Raut{i} + Rin{j)) < {x - 2y)rij + 2yc. 
Hence to verify that this volume is smaHer than the Unk capacity, we have to ensure that 

{x - 2y)nj + 2yc < ere/ (n - 1) . (9) 
Restricting ourselves to a choice of x and y satisfying 

2y<x (10) 
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allows us, noting that < c, to replace requirement (9) by the stronger one 

(x - 2y)c + 2yc < 9rc/{n - 1), 

or 

X < Brjin - 1). (11) 

Thus any choice of a satisfying constraints (6), (7), (8), (10) and (11) will yield a 
valid routing satisfying the requirement a • i?. 

Let us jBdc a; = drj{n — 1) and thus satisfy constraint (11), and get rid of the occurrence 
of a: in constraints (7) and (10). Rewriting constraints (7), (8) and (10) as 

a. - 9T/{n - 1) 



y > 
y < 



(n-2) 
2(1 -a) 



(n-1) ' 

we see that in order for a solution y to exist, we must have the following two inequalities: 

a - dr/jn - 1) ^ 2(1 - a) 

(n-2) - (n-1) ' 
a - 9T/{n - 1) dr 



(n-2) - 2(n - 1) ' 



Rearranging, we get 



< TTr (13) 

" 2(n-l) ^ ^ 

Noting that Or/2 < 2^^, we strengthen constraint (13) by requiring o; to satisfy 

a<dr/2, (14) 

We are left with a set of three constraints, (6), (12) and (14), such that any choice 
of a satisfying all three is achievable (i.e,, the requirement matrix a * R can be satisfied)* 
The breakpoint between constraints (6) and (14) is for r = 2/3. Let us first consider 
the case r > 2/3. In this case, constraint (6) dominates (14). Further, in the range of 
1 ^ ^ ^ 3{w) constraint (6) dominates also constraint (12), hence the best that can be 
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achieved is a = ^(1 — r). In the range oi 9 > j^^ttj constraint (12) is dominant, and it is 
possible to achieve a == ^^3—^- Noting that in this range (of r > 2/3) we have 

2 9{2t - 1) ^ 2n-A + 9r 

the jBrst claim of the lemma follows. 

Let us next consider the case r < 2/3. In this case, constraint (14) dominates (6). 
Further, in the range of 1 < ^ < ~ constraint'(14) dominates also constraint (12), hence the 
best that can be achieved is a = dr/2. In the range of ^ > ~: constraint (12) is dominant, 
and again it is possible to achieve a = Note that in this range (of r < 2/3) we have 

2 gr ^ 2n - 4 + gr 

3^2(3n"5) - 3n-5 ' 

and hence the second claim follows as well. 1 

H.3 Extending the transmission capability by k 

Suppose we wish to expand the transmission capability of the complete network by a large 
factor fc. It seems from our discussion that the most efHcient way to do so would be as follows. 
Start by expanding only the edge capacities by a factor of Ofyreak* From that point and on, 
continue by expanding both edge and switch capacities uniformly (by a factor of k/dfyreak)* 
Overall, the edges are expanded by a factor of whereas the switches are expanded only by 

a factor of k/dtreak- 

Computational relationships in capacity-extended channels in communication, specifi- 
cally under uniform traflSc requirements provided in accordance with a preferred embodi- 
ment of the present invention are now described. This analysis was derived by Dr. Raphael 
Ben-^Ami from BARNET Communication Intelligence Ltd, ISRAEL, and Professor David 
Peleg from the Department of Applied Mathematics and Computer Science, The Weizmann 
Institute of Science, Rehovot, 76100 ISRAEL. Professor David Peleg is not an inventor of 
the invention claimed herein, 

I Analysis of Uniform Traffic Requirements 

We now analyze the potential gains from the expansion of link capacities in the same model 
studied before, but under the assumption that the requirements matrix is R^, characterized 
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c 



. This is a maximal matrix, as for every switch vi we have Routii) = Rin{i) — 



(n ~ 1) X 2(^:1)? hence Rsum{i) = c. We will now derive some tight bounds on a{£e{G^r)) 
for various values of 6 and various simple regular topologies G, 

Let us remark that as it turns out, in all of the cases examined, the general dependency 
of a{SQ{G, r)) on d looks as in the graph of Fig, 34, or more formally, 



where amax ~ dstart • hreak and the values of ocstaru otmax and Oiyreak depend on the specific 
topology at hand (as well as on r). In what follows we refer to this type of function as a 
plateau function, and denote it by Plateau(Q;stari5 ^max)- 

(In most 'of our bounds, the description of the function is slightly complicated by the 
fact that astaTt is dependent on the value of r; in particular, it assumes a different value 
according to whether r is smaller or greater than some threshold value Threak*) 

I.l The Complete Network 

Lemma I.l The transmission quality of the d-expanded network £${Cn, r) under the uniform 
requirements matrix is a{£o{Cn, r)) = Plateau(a5£artj <^77iax) where astart ~ 2 min{r, 1 — 
r } and amax = 1 ^ 

Proof: Since R^ is uniform and and the underl3dng network is complete, it is easy to verify 
by symmetry arguments that the most efficient solution would be to transmit the traffic from 
i to j along a single path, namely, the direct edge connecting them. The requirement that 
the edge capacity suffices for the intended traffic translates for an inter-switch edge into the 
inequality 



a{fe(G,r)) = i 



& > Sbreak > 




n-l - 2(n-l) ' 



or 



a < 29r. 



(15) 



For a site-switch edge we get the inequality ^(1 — r)c > ac/2, or 



a < 29{1-t). 



(16) 
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The choice of routes ensures that the switch capacity suffices for transmitting the entire 
requirement for a maximal matrix, and nothing more, namely, 

a < 1. (17) 

The bounds expressed by inequalities (15) and (16) coincide when r = 1/2. In case 
r < 1/2, the bound expressed by inequality (16) is dominated by that of inequality (15), and 
the opposite holds in case r > 1/2. Hence the bounds specified in the lemma follow. | 



1.2 Rings 

Let us next consider the simple ring topology R, For simplicity of presentation we assume 
that n is odd, and the switches are numbered consecutively by 0 through n — 

Lemma 1.2 The transmission quality of the 6 -expanded n-site network £e{R, r) (for odd n) 
under the uniform requirements matrix RF is a{£e{R,T)) — Plateau(a5tartj Q^max); where 

_ 8 

^max — 



and 



^start — ^ 



for 



n + 5 

2(1 - r) , T^^k < r < 1 , 
_ n-f- 1 

"^break — 



n + 5 

Proof: Again, by symmetry considerations we can show that the best solution is obtained if 
one transmits the traffic from Si to Sj along the shorter of the two paths connecting them on 
the ring, for every i and j. We now have to estimate the loads on switches and links under 
this routing pattern. 

Let us sum the total traffic load on the ring edges. Consider first the traffic originated at 
site $i. For every 1 < j < (n - l)/2, there are two routes of length j out of 5^ (one clockwise 
and one counterclockwise). Each such route loads j edges with ac/2{n — 1) traffic. Hence 
the total traffic load generated by Si is 

^""v^^^- _ (n + l)ac 

]r{ ^^•2(n-l)" 8 ' 
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and the total traffic load overall is n(n + l)o;c/8. As this load distributes evenly among the 
2n directed links, the load on each link of the ring is (n + 1)q:c/16. This must be bounded 
by the link capacity, hence we get 

Ore ^ (n + l)ac 
~ - 16 ' 

or 

A similar calculation should be performed for the switches. Again, we first consider the 
traflfic originated at site Si. For every 1 < j < (n — l)/2, there are two routes of length j out 
of Si. Each such route loads j -f 1 sites (including the endpoints) with acj2[n — 1) traffic. 
Hence the total traffic load generated by Si is 

h 2(n-l)- 8 ' 

and the total traffic load overall is 

n{n + o)ac 
8 ' 

As this load distributes evenly among the n sites, the load on each site on the ring is 
(n + 5)qjc/8. This must be bounded by the site capacity, c, hence we get 

Finally, for a site-switch edge we get, as before, the inequality 

a < 25(1 -r). (20) 



Of the three inequalities (18), (19) and (20), bound (19) does not depend on 6, and 
therefore limits the value of Umax* The value of astart depends on r. The bounds expressed 
by inequalities (18) and (20) coincide when r = (n+ l)/(n + 5). In case r < (n + l)/(n-i-5), 
bound (20) is dominated by bound (18), and the opposite holds in case r > (n + l)/(n + 5). 
For each of these cases, the bounds specified in the lemma now follow by a straightforward 
case analysis. I 

For the case of even n, the bounds we get are similar. The main difference in estimating 
the load caused by site Si is that in addition to the routes considered for the odd case, there's 
also a single route of length n/2 out of Si, to the farthest (diagonally opposing) site. 
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Lemma 1*3 The transmission quality of the 9-expanded n-site network £Q{R^r) (for even 
n) under the uniform requirements matrix BF is a{£B{R, r)) = 'PlsiteBu{astarti o^max), where 

8(n - 1) 



and 
for 



+ 4n - 4 

2(1 - r) , Tareafc < < 1 



^2 

n 



^break — 



n2 + 4n — 4 

Example: Consider the 4- vertex ring in a configuration of r = 1/2 and switch capacity 
c = 1000. In this setting we have astart — 3/4 and ama^^ ^ 6/7, hence Otreak = 8/7. The 
traffic requirements are r^j = 1000/6 167 for every 1 < i,i < 4. For 5 = 1 (no link 
expansion) we get that 3/4 of this traffic, i.e., fij = 125 for every 1 < i,i < 4, can be 
transmitted. At this point, the traffic saturates the inter-switch finks, whose capacity is 250 
units. (See Fig. 28(a).) 

Now suppose the links are expanded to the maximum possible ratio of ^ = 8/7, i.e., their 
capacity becomes 2000/7 w 286. It then becomes possible to transmit 6/7 of the traffic, 
i.e., fij = 1000/7 ^ 143 for every 1 < i j < 4. Th^ saturates both the inter-switch links 
and the switches. (At this point, each switch handle a flow of 3000/7 ^ 429 units from its 
site to the other sites, a similar flow in the opposite direction, and an additional amount of 
1000/7 ^ 143 units of flow between other sites, as an intermediate switch alone the route). 
Hence further expansions of the links without any corresponding expansion of the switches 
will not increase the network throughput. 

As an example for an odd-size network, consider the 5- vertex ring, again in a configuration 
of T — 1/2 and switch capacity c = 1000. In this setting we have astart = 2/3 and a^ax = 4/5, 
hence Btreak = 6/5. The traffic requirements are r^j = 1000/8 =: 125 for every 1 <i,j <5. 
Yoi e = 1 we get that 2/3 of this traffic, i.e., fij = 250/3 ^ 83 for eviery 1 < j < 5, can 
be transmitted. At this point, the traffic saturates the inter-switch links, whose capacity is 
still 250 units. 

Now suppose the Unks are expanded to the maximum possible ratio of ^ = 6/5, i.e., their 
capacity becomes 300. It then becomes possible to transmit 4/5 of the traffic, i.e., /^j ~ 100 
for every 1 < < 5. This saturates both the mter-switch links and the switches. (At this 
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point, each switch handle a flow of 400 units from its site to the other sites, a similar flow 
in the opposite direction, and an additional amount of 200 units of flow as an intermediate 
switch between its two neighboring sites). Again, further increases in throughput would 
require increasing both the link and the switch capacities. 

1.3 Chordal Rings 

Next we consider the simple chordal ring topology CR, For simplicity of presentation, assume 
that n is divisible by 4, and the switches are numbered consecutively by 0 through n — 1, 
where each pair of diametrically opposite switches is connected by a chord. 

Lemma 1.4 The transmission quality of the O-expanded network £q{CR^t) of size n >12 
under the uniform requirements matrix is a{6${CR^T)) = Flatea.n{astaru Oimax) ^ where 

... 16(n-l) 

OCraax ^2 + I2n - 16 

and 

^start 



2(1 - r) , Tbreak < T < 1 , 



for 

' break 



3n2 + 16n - 16 ' 

Proof: By symmetry considerations, the best solution is based on breaking traffic originated 
at Si into two classes: traffic destined at a site within distance < i from Si on the ring (either 
clockwise or counterclockwise), will be sent entirely over the ring. Traffic destined at farther 
sites will be sent first over the chord to V{i^n/2)modnj continue on the ring from there 
(either clockwise or counterclockwise) . see Fig. 35 for a schematic description of this routing 
with i — n/4. 

As done for the ring, let us sum the load on the ring edges created by traffic originated 
at site Si. For every 1 < j < i, there are two routes of length j out of Si (one clockwise 
and one counterclockwise), and each such route loads j edges with ac/2{n — 1) traffic. In 
addition, for every l<i<n/2 — 1, there are two routes of length j + 1 out of Si via the 
chord. Hence the total traffic load generated by $i over ring edges is 



fri ' 2(n-l) 2(n -l) \ 2 8 
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4(n-l) * 

The total traffic load overall is n times larger, and as this load distributes evenly among the 
2n directed ring links, the load on each link of the ring is — 2nl + 4^^ — n 4- 4£) g^^Ti) • 

This must be bounded by the link capacity, BrcjZ^ hence we get 

- 3(n2 -h 8^ - 47^^ - 2n + 8£) ' ^ ^ 

We next carry a similar calculation for the switches. Summing separately over direct 
routes on the ring and routes going through the chord, the total traffic load generated by Si 
over ring switches is 

= (n^ - Ani -f- + 6n - 8) ' . 

8(n — 1) 

The total traffic load overall is n times larger, but it is distributed evenly among the n 
switches. The load on each switch must be bounded by its capacity, c, jdelding the inequality 

(n^-4n^ + 8^^ + 6n-8)--7 -r < c, 

8(n — 1) 

or 

8(n-l) 

- n2 - 4n^ + 8^ + 6n - 8 ■ ^ ' 

For a site-switch edge we get, as before, the inequality 

a < 25(1 -r). (23) 

Finally, we need to estimate the load on chord edges. This is done similar to the analysis 
for ringe edges, and yields the bound 

25r(n-l) 

- Z{n-2i-l) ' ^ 

For small values of n {up to n ~ 11), the best choice of I and hence the resulting values 
of a can be determined from the bounds specified by inequalities (21), (22), (23) and (24) by 
direct examination. For n > 12, simple analysis reveals that bound (24) is always dominated 
by bound (21), and hence can be discarded. We are thus left with the bounds (21), (22) and 
(23)* To maximize a, we need to minimize 
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and 

/2 (i) ^ri^^4n£ + S£^ + 6n~ 121 - 8. 

As can be expected, both functions are minimized very close to ^ = n/4, which therefore 
becomes a natural choice for £. Under this choice, our bounds can be summarized as 

329T{n - 1) 

16(n - 1) 
n2 + 12n - 16 ' 
25(1 -r). 

J3 The analysis continues from here on along the lines of that of the ring, yielding the 
I'l bounds specified in the lemma. | 

2 Example: Consider the 8-vertex chordal ring in a configuration of r = 1/2 and switch 
y capacity c = 1200. The traffic requirenients are Vij = 600/7 ^ 86 for every 1 < < 8. 
P As n < 11, we examine the possible values for i (which are 0 < ^ < 4), and calculate the 

□ resulting bounds on a from inequalities (21), (22), (23) and (24). It turns out that the best 
^fl choice is ^ = 2. For this choice, the smallest bound on g: for 5 = 1 is astart < 7/12. This 
n means that it is possible to transmit an amount of fij = 50 units far every 1 < ^, j < 8. 

□ At this point, the traffic saturates the inter-switch links, whose capacity is 200 units. For 
example, supposing the vertices of the ring are through vs^ the link from vi to V2 carries 
the 50 traffic units from Su and Ss to 52, as well as from Si to 53 (see Fig 36). 

In case the link capacities are expanded by a factor of d, the bounds we get on a from 
inequalities (21), (22), (23) and (24) for ^ 2 are a < 7^/12, a < 7/9, a < ^ and a < 76/9. 
Hence amax = 7/9, and 9^eak = 4/3. Expanding the links to the maximum possible ratio of 
^ = 4/3 brings their capacity to 800/3 ^ 267. It then becomes possible to transmit 7/9 of 
the traffic, i.e., fij = 200/3 ^ 67 for every 1 < < 8. This saturates both the inter-switch 
links and the switches. (At this point, each switch handle a flow of 1400/3 units from its 
site to the other sites, a similar flow in the opposite direction, and an additional amount of 
800 /3 units of flow between other sites, as an intermediate switch alone the route, summing 
up to 1200 flow units). 

1.4 A;-Chordai Rings 

The next network we consider is the chordal ring with K >2 chords, CR{K). For simplicity 
we assume that n is of the form n = (2£ + l)(isr + 1) for integer ^ > 1, and the switches are 



a < 

a < 
a < 
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numbered consecutively by 0 through n - 1. Each switch i is connected by a chord to the 
switches {i + jnj {K + 1)) mod n for j = 1, . . . , 

Lemma 1.5 The transmission quality of the d-expanded network Se{CR{K),r) under the 
uniform requirements matrix BF is a{SB{CR{K),r)) V\dLtean{astaTuOimax), where 

2(n-l) 



and 



{K + l)e + {5K'h3)£ + 2K 



4r(n-l) T < 7- 

(K-M)(K+2)£(£4-l) ' — ^break 



for 

' ^break 



2(1 - r) , Tbreak < T < 1 , 

[K+l] {K + 2)ei£+l) 



{K + + + 1) + 2(n - 1) * 

Proof: By symmetry considerations similar to the case of the simple chordal ring it is clear 
that a near optimal solution is obtained by breaking traffic originated at 5^ into i^-f 1 classes. 
The first class consists of traffic destined at a site within distance < t from si on the ring 
(either clockwise or counterclockwise). This traffic will be sent entirely over the ring. Traffic 
destined at farther sites will be sent first over one of the chords, and continue on the ring 
from there (either clockwise or counterclockwise). See Fig, 37 for a schematic description of 
this routing on the 3-chordal ring with ^ = n/8. 

Let us sum the load on the ring edges created by traffic originated at site 5^. For every 
1 < J < ^5 there are two routes of length i out of Si (one clockwise and one counterclockwise), 
and each such route loads j edges with ac/2(n - 1) traffic. In addition, for every 1 < j < ^, 
there are routes consisting of one chord plus j ring edges out of Si via the K chords. 
Hence the total traffic load generated by Si over ring edges is 

^""^'^P'-W^) = 2(n-l) ■ 

Summing the total traffic load over all sources Si and averaging over the 2n directed ring 
Hnks, the load on each link of the ring is ""^^ff^^^ This must be bounded by the link 
capacity, 6tc/{K + 2), hence we get 

^ <, 4gT(n - 1) , . 
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A similar calculation for the switches reveals that the load generated by the traffic originating 
at a site Si is 

- Q;c((ii: + 1)^=^ + {bK + 3)i + 2K) 
~ 2(ra-l) 

(The first main summand represents loads on routes through chords, counting separately the 
unique route to the diagonally opposite site; the second main summand represents loads on 
direct routes, not using a chord). Summing over all n sources and averaging on n switches 
yields the inequality 

< 2(n - 1) 

- {K + l)i^ + {5K + 3)e + 2K ' ^ ' 

For a site-switch edge we get, as before, the inequality 

a < 2^(1 -r). (27) 

Finally, for a chord edge we get 

2gr(n-l) 

^ ^ (if + 2)(2^+l) • ^28) 

This bound is dominated by (25) whenever K >Z {ox K ^2 and ^ > 2), and therefore can 
be ignored (say, for n > 9). The analysis continues from here on along the lines of that of 
the ring, yielding the bounds specified in the lemma. | 

Example: Consider the 21-vertex 2-chordal ring in a configuration of r = 1/2 and switch 
capacity c = 5040. As -R^ - 2 and £ - 3, we get Ureak = 18/23 > r, and hence for ^ = 1 we 
get astart = 5/18. The traffic requirements are^r^j = 5040/40 = 126 for every 1 <i,j < 20, 
of which it is possible to transmit an amount of fij = 35 units for every 1 < i, j < 20. At this 
pointj the traffic saturates the inter-switch links, whose capacity is 630 units. For example, 
supposing the vertices of the ring are Vi through ^20? the link from Vi to V2 participates in 18 
routes, carrying the 35 traffic units for each (specifically, it is involved in six direct routes, 
namely, pij for (ij) E {(1, 2), (1, 3), (1,4), (21, 2), (21, 3), (20, 2)}, six routes via the chords 
leading to Vi, namely, pij for (ij) e {(8, 2), (8, 3), (8, 4), (15, 2), (15,3), (15,4)}, four routes 
via the chords leading to V2u namely, Pij for (ij) 6 {(7,2), (7,3), (14, 2), (14,3)}, and two 
routes via the chords leading to V20, namely, pij for (ij) E {(6,2), (13,2)}.) 

The link capacities can be expanded by a maximal factor of Obreak = 72/35 > 2, leading 
to amax — 4/7. Expanding the links by this ratio brings their capacity to 630* 72/35 = 1296. 
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It then becomes possible to transmit 4/7 of the traffic, i.e., fij = 126 • 4/7 — 72 for every 
I < i,j ^ 20. This saturates both the inter-switch links and the switches, requiring any 
further expansion to include the switches as well*. 

Reference is now made to Fig. 38 which is a simplified functional block diagram of 
bandwidth allocation apparatus constructed and operative in accordance with a preferred 
embodiment of the present invention. Reference is also made to Fig. 39 which is a simplified 
flowchart illustration of a preferred mode of operation for the apparatus of Fig. 38. As 
shown, the apparatus of Fig. 38 includes a conventional routing system 500 such as PNNI 
(Private Network-Network Interface) Recommended ATM Forum Technical Committee. The 
n routing system 500 may either be a centralized system, as shown, or a distributed system 
S distributed over the nodes of the network. The routing system allocates traffic to a network 
□ 510. The routing system 500 is monitored by a routing system monitor 520 which typically 
fl accesses the routing table maintained by routing system 500. If the routing system 500 is 
S centralized, the routing system monitor is also typically centralized and conversely, if the 
routing system is distributed, the routing system monitor is also typically distributed. 

;n The routing system monitor 520 continually or periodically searches the routing table for 
::; congested links or, more generally, for links which have been utilized beyond a predetermined 
threshold of utilization. Information regarding congested links or, more generally, regarding 
'■"^ links which have been utilized beyond the threshold, is provided to a link expander 530. Link 
expander 530 may either be centralized, as shown, or may be distributed over the nodes of 
the network. The link expander may be centralized both if the routing system monitor is 
centralized and if the routing system monitor is distributed. Similarly, the link expander may 
be distributed both if the routing system monitor is centralized and if the routing system 
monitor is distributed. Link expander 530 is operative to expand, if possible, the congested 
or beyond-threshold utilized links and to provide updates regarding the expanded links to 
the routing system 500. 

It is appreciated that various features of the invention which are, for clarity, described 
in the contexts of separate embodiments may also be provided in combination in a single 
embodiment. Conversely, various features of the invention which are, for brevity, described 
in the context of a single embodiment may also be provided separately or in any suitable 
subcombination. 

It will be appreciated by persons skilled in the art that the present invention is not limited 
to what has been particularly shown and described hereinabove. Rather, the scope of the 
present invention is defined only by the claims that follow: 
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